J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




@ Publication number: 0 475 581 A2 



EUROPEAN PATENT APPLICATION 



(2?) Application number: 91307235.1 
(22) Date of filing : 06.08.91 



© int. ci. 5 : G06F 9/46 



(So) Priority : 30.08.90 US 575257 



(43) Date of publication of application : 
18.03.92 Bulletin 92/12 



(84) Designated Contracting States : 
DE FR GB 



@ Applicant : Hewlett-Packard Company 
3000 Hanover Street 
Palo Alto, California 94304 (US) 



@ Inventor: Garfinkel, Daniel 
5239 Fox Hills Drive 
Fort Collins, CO 80526 (US) 
Inventor : Louder, Stephen A 
P.O. Box 52193 
Pacific Grove, CA 93950 (US) 
Inventor : Wildman, Richard C 
6351 Compton Road 
Fort Collins, CO 80525 (US) 

@ Representative : Colgan, Stephen James et al 
CARPMAELS & RANSFORD 43 Bloomsbury 
Square 

London WC1A 2RA (GB) 



(54) Method and apparatus for window sharing between computer displays. 



(57) A method and apparatus for sharing a local display signal from a local computer display (10) to at 
least one remote computer display (20) is shown to include generating a connection (54) with the 
display server (30) associated with the remote computer display (20) in response to a signal from the 
local workstation input device (16) generating a remote display signal (62, 64) in relation to the local 
display signal in response to a second signal from the input device (16), wherein the generation of the 
remote display signal involves dynamically creating a list of display resources (76, 78) for the remote 
computer display and generating the remote display signal (90) in relation to the display resources and 
transmitting the remote display signal to the remote display server (30). Where the local display signal is 
shared among multiple remote computer displays (20), the generation of remote display signals creates 
a list of display resources for each of the remote computer displays, which list is updated for each 
rendering of the local display signal. In such a situation, the remote display signal for each remote 
computer display is generated in relation to the associated display resources. In one embodiment, the 
local display signal is a window based display signal, preferably X-windows. The generation of such a 
window based signal defines a window instance. Graphics contexts are dynamically allocated (86, 88) 
for each window instance and are stored remotely while identification information is stored locally. 
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Field of the Invention 

The present invention relates generally to the 
field of generating computer screen displays and par- 
ticularly to methods and apparatus for sharing com- 
puter displayed images among several computers. 

Background of the Invention 

Computer display products are now available 
which allow the researcher or word processor to study 
or view various types of data on a computer screen. 
In order to utilize such products, a user typically would 
employ a computer, a display screen and some 
means of interacting with the computer, i.e., 
keyboard, mouse, graphics board, etc. Often it is desi- 
rable for two or more users to view the same screen 
display at the same time in different locations and for 
such users to each have the capability to make mod- 
ifications to the screen display. 

One type of computer display product which is 
becoming increasingly popular creates windows 
within a screen display, where data of interest is dis- 
played within the window. The use of windows is 
advantageous because windows permit the concur- 
rent, segregated display of different data on the same 
display screen. The computer programming which 
controls window generation and the data displayed 
within a given window is known as a window server. 
One particular window server which has become 
popular is the X-window server, such as the X-1 1 win- 
dowing program developed and openly distributed by 
the Massachusetts Institute of Technology in 
Cambridge, Massachusetts. 

It has been suggested in the past to share win- 
dows, i.e., to remotely display one or more of the win- 
dows displayed on a local computer screen and 
further to allow remote users to make modifications to 
the data displayed in such windows. In particular, it 
has also been suggested to share windows based 
upon the X Window System. Basically two 
approaches to sharing windows have been proposed, 
the centralized approach and the replicated 
approach. 

In the replicated approach a copy of the appli- 
cation or program which is being served by the win- 
dow server is duplicated for each remote location. To 
ensure that the various computer screens are display- 
ing the same information, the input from each user is 
merged and presented to each copy of the application 
for display. The replication approach has the advan- 
tages of avoiding delays in the application output path 
and it allows each copy of the application to provide 
the best rendering for each display screen. However, 
since each copy of the application is running indepen- 
dently, consistency has been a problem. In addition, 
all copies of the application must be started at the 
same time, thereby disallowing any after-the-fact 



sharing. 

In the centralized approach, one copy of the appli- 
cation is run through a process, known as a bridge, 
which transmits rendering commands to each remote 

5 user and which merges user input and presents the 
merged input to the application. Although the cen- 
tralized approach allows users to be added after-the- 
fact, there is a performance delay in the output path 
associated with the use of only one application. 

10 Consequently, there is a need for devices and 

methods which provide for the sharing windows, allow 
after-the-fact sharing and which do not suffer perform- 
ance delays in the output path. 

15 Summary of the Invention 

The advantages of the invention are achieved in 
a method and apparatus for sharing a local display 
signal from a local computer display to at least one 

20 remote computer display is shown to include generat- 
ing a connection with the display server associated 
with the remote computer display in response to a sig- 
nal from the local workstation input device generating 
a remote display signal in relation to the local display 

25 signal in response to a second signal from the input 
device, wherein the generation of the remote display 
signal involves dynamically creating a list of display 
resources for the remote computer display and 
generating the remote display signal in relation to the 

30 display resources and transmitting the remote display 
signal to the remote display server. Where the local 
display signal is shared among multiple remote com- 
puter displays, the generation of remote display sig- 
nals creates a list of display resources for each of the 

35 remote computer displays, which list is updated for 
each rendering of the local display signal. In such a 
situation, the remote display signal for each remote 
computer display is generated in relation to the 
associated display resources. In one embodiment, 

40 the local display signal is a window based display sig- 
nal, preferably X-windows. The generation of such a 
window based signal defines a window instance. 
Graphics contexts are dynamically allocated for each 
window instance and are stored remotely while iden- 

45 tification information is stored locally. 

Brief Description of the Drawings 

The present invention will be better understood, 
so and its numerous objects and advantages will 
become apparent to those skilled in the art by refer- 
ence to the following detailed description of the inven- 
tion when taken in conjunction with the following 
drawings, in which: 
55 Fig. 1 is a diagrammatic view of a shared display 

device operated in accordance with the principles 
of the present invention; 

Fig. 2 is a more detailed diagrammatic view of the 
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local window server, including the present inven- 
tion, shown in Fig. 1; 

Fig. 3 is a flow chart depicting the operation of 

extension 34 in sharing a display signal; 

Fig. 4 is a flow chart of the operation of extension 

34 in generating a list of display resources; 

Fig. 5 is a flow chart of the operation of extension 

34 in obtaining graphics contexts; 

Fig. 6 is a flow chart of the operation of extension 

34 in controlling input events generated by 

remote computer displays; and 

Fig. 7 is a flow chart of the operation of extension 

34 in the unsharing of a display signal. 

Detailed Description of the Preferred Embodiment 

A new and novel means for sharing a local display 
signal from a local computer display to at least one 
remote computer display is generally shown in Fig. 1 . 
A local computer display 1 0 includes a central proces- 
sing unit (CPU) 12, a display screen 14, and an input 
device for keyboard 16. Remote computer display 20 
includes a central processing unit 22, a display screen 
24 and a keyboard 26. Both central processing units 
1 2 and 22 each include a display server 28 and 30, re- 
spectively. An application or program 32 is also con- 
tained in CPUs 12 and is depicted as interacting 
directly with display server 28. 

As will be understood by those familiar with com- 
puter displays, application 32 is generally a software 
based program which is loaded into the memory of 
CPU 1 2 for processing by the micro-processor device 
incorporated within the CPU. It will also be understood 
that display server 28 is generally a software program 
which processes the output of application 32 in the 
generation of a display signal to be displayed on 
screen 14. For example, if display servers 28 and 30 
are window based display servers, the output of appli- 
cation 32 will be manipulated for display within one or 
more windows formed on display screen 14. 

As indicated above, the present invention invol- 
ves the sharing of display signals between computer 
display 10 and remote computer display 20. To this 
end, a display server extension 34 has been 
developed and is shown connected to display server 
28. Extension 34 permits those display signals gener- 
ated by application 32 and interpreted by server 28 to 
be shared among multiple computer displays. Gener- 
ally, extension 34 accomplishes the sharing operation 
by interpreting and retransmitting the window system 
protocol generated by application 32 to remote server 
30. As will be described in greater detail herein, dis- 
play server extension 34 includes generates a con- 
nection with display server 30, generates a remote 
display signal in relation to the signal displayed on dis- 
play screen 14, and transmits that signal to display 
server 30. It should be noted that remote server 30 
need not include an instance of extension 34 in order 



to display a shared from local computer display 10. 

In the preferred embodiment, display servers 28 
and 30 are X window servers for which source code 
is available from the Massachusetts Institute of 
5 Technology in Cambridge, Massachusetts, particu- 
larly, Protocol Version 1 1 , Release 4. Also in the pre- 
ferred embodiment, extension 34 is implemented in 
software which software is written in "C" programming 
language. 

10 Throughout this description, it is assumed that 

any communication which takes place between local 
and remote CPUs is achieved via any known and 
appropriate communication network utilizing known 
communication devices. In the preferred embodiment 

15 of the present invention, computer displays 10 and 20 
can be any known computer display having a suffi- 
cient memory and speed for operating a display ser- 
ver and for communicating with other computer 
displays. The present invention has been implemen- 

20 ted using HP9000 Series 300 computer equipment 
utilizing the HPUX operating system version 7.0 and 
TCP/IP Ethernet networking. 

Referring now to Fig. 2, the display server 28 and 
its relationship to the present invention is more par- 

25 ticularly disclosed. It will be noted that hereafter the 
description of the invention is made in terms of the 
preferred embodiment, i.e., the embodiment which 
utilizes the MIT X-server. Display server 28 is seen to 
include three major components, namely, the device 

30 independent component (DIX) 40, the device depen- 
dent component (DDX) 42 and an operating system 
component (OS) 44. In normal operation, display ser- 
ver 28 receives commands from and communicates 
with application 32 via the device independent com- 

35 ponent 40. Signals which are device dependent, i.e., 
the display signal or the keyboard signal, are sent 
from or received by the device dependent component 
42. The double ended arrows depicted in Fig. 2 indi- 
cate which components of display server 28 com- 

40 municate with each other and which components of 
display server 28 communicate with display server 
extension 34. The communication between the com- 
ponents of display server 28 and with display server 
extension 34 are achieved in any known fashion, such 

45 as through the use of calls and events. 

There is also shown in Fig. 2 an X library (Xlib) 42 
connected to display server extension 34. As will be 
appreciated by those knowledgeable in the use of X 
windows, X library 46 is an available product used for 

so communicating with X servers. In the preferred embo- 
diment, display server extension 34 is built on Xlib 46 
and Xlib 46 is the X library program available from 
Massachusetts Institute of Technology, Version 11, 
Release 4. 

55 In operation, extension 34 shares those windows 

created by server 28 in response to a share com- 
mand. In other words, if there has been an indication 
to share a window displayed on screen 14, all 
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changes, modifications or renderings of that window 
will be shared by extension 34 to all remote computer 
displays designated to receive the shared display sig- 
nal. 

More particularly, in response to a command sig- 
nal, extension 34 generates a connection with the dis- 
play server associated with the remote computer 
display, i.e, display server 30, and generates a remote 
display signal in relation to the local display signal pro- 
vided by DDX component 42. The generation of the 
remote display signal involves two operations. First, 
display server extension 34 dynamically creates a list 
of display resources for remote computer display 20. 
Thereafter, the remote display signal is generated in 
relation to the dynamically created list of display 
resources. Thereafter, the remote display signal is 
transmitted through X library 46 to remote display ser- 
ver 30. In this fashion, the desired display signal is 
transmitted utilizing X window protocol to multiple dis- 
play screens. Dynamic creation of the list of display 
resources indicates that the list is created or updated 
for each rendering of the display signal. 

A user interface 48 generates the command sig- 
nal utilized by display server extension 34 to share the 
display signal. It is noted that signals from user inter- 
face 48 are provided to the device independent com- 
ponent 40 and that signals to interface 48 are 
provided from display server extension 34. A more 
detailed description of the share operation is made in 
relation to Fig. 3, and a more detailed description of 
the dynamic creation of the list is made in relation to 
Fig. 4. 

Referring now to Fig. 3, the operation of extension 
34 is depicted in relation to a sharing task. A share 
command is received at 50 resulting in extension 34 
determines at 52 whether a connection to the desig- 
nated remote display has been made. If it is deter- 
mined that a connection has not been made the 
connection is opened at 54. Extension 34 determines 
at 56 whether the connection has been successfully 
made. If the connection has not been successfully 
made an error message is returned to user interface 
48 at 58 indicting the lack of a connection. If it is deter- 
mined that a connection was successfully made at 56 
the programming of extension 34 next determines 
whether all application windows are being shared at 
60. It will be noted at this point that the share com- 
mand received at 50 will be indicative not only of an 
intent to share, but whether a single window is being 
shared or all windows associated with application 32. 
If it is determined at 60 that all application windows are 
being shared, an instance of all application windows 
is generated at 62. If it is determined that application 
32 is not been shared, then an instance of the single 
designated window is made at 64. Instances created 
at 62 and 64 are processed through X library 46 and 
transmitted to all connections and a return success 
message is generated at 66 and provided to user 



interface 48. 

Referring now to Fig. 4, when the share command 
has been generated display server extension 34 
dynamically creates a list of display resources. Refer- 

5 ring to Fig. 4, the list is dynamically created by first 
getting those resources necessary to display the sig- 
nal being share. There resources are obtained at 70 
one at a time. A determination is made at 72 whether 
the resource being retrieved in fact exists at the 

10 remote computer display. If the resource exists an 
access identifier is returned to extension 34 at 74. If 
a remote resource necessary to share the display sig- 
nal does not exist, that resource is created at 76. 
Created resources are stored in each of the remote 

15 computer displays. Access identifiers are stored by 
the local computer display so that such resources can 
be obtained and used when required. The access 
identifier associated with the resource created at 76 
is stored locally at 78 and a return is generated at 80 

20 indicating that an access identifier exists. The oper- 
ation described in Fig. 4 is repeated until the access 
identifications have been obtained for all resources 
necessary to share the desired display signal. It is 
noted that the list of display resources is dynamically 

25 generated when the creation of each connection to a 
remote computer display whether one window or all 
windows of a particular application are to be shared. 

The dynamic creation of display resources also 
results in the creation of graphic contexts. Display ser- 

30 ver extension 34 dynamically allocates graphic con- 
texts for each local graphic context for each remote 
computer display. For example, one component of the 
graphics context is the font selection. Display server 
extension 34 allocates the font selection for each 

35 remote computer display as part of the graphic con- 
texts for that remote computer display. If it is not poss- 
ible to allocate the same font selection for the remote 
computer display, it is preferred that a font most 
closely resembling that utilized in the local computer 

40 display, be allocated. In other words, the list of display 
resources and/or graphics contexts are generated so 
that the image displayed at the remote computer is 
substantially identical to that image displayed at the 
local computer display. 

45 Referring now to Fig. 5, the graphics contexts ret- 

rieval and assignment process is shown in greater 
detail. When it is necessary to determine graphics 
contexts, i.e. whenever the display signal is to be ren- 
dered, the graphics contexts for each remote display 

so are obtained at 82. The determination is made at 84 
whether sufficient graphics contexts exist in order to 
display the designated windows. If sufficient graphics 
contexts do not exist, an assignment of missing 
graphics contexts is made at 86. Similar to the gener- 

55 ation of display resources, the graphics contexts are 
stored in their respective remote computer displays at 
88 and access identifiers are stored in local computer 
display 12. Once all missing graphics contexts have 
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been stored remotely and access identifiers stored 
locally, the shared display signal is generated at 90. 
To this end, it is necessary that each computer display 
have a memory associated with the central proces- 
sing unit. If a remote graphics context has not been 
assigned and if a sufficiently similar graphics context 
is not available, the window will not be shared and an 
error message will be sent to user interface 48. 

As shown in Fig. 1, computer display 20 is pro- 
vided with a keyboard 26. In the preferred embodi- 
ment of the present invention, the user who utilizes 
computer display 20 is able to make modifications of 
the data displayed in the shared window. In other 
words, each of the input devices 16 and 26 are cap- 
able of generating input events to be processed by 
application 32. In such a situation, display server 
extension 34 includes an input event controller which 
controls the input events to be processed by appli- 
cation 32. The input event controller determines 
which of the input devices will be capable of generat- 
ing input events to be processed by the application. 
This is accomplished by defining either of the com- 
puter displays 10 or 20 as a current input instance. 
Only the current input instance can effect changes or 
modifications of the displayed signal. In one embodi- 
ment of the invention, the input event controller 
defines as the current input instance that computer 
display which is currently generating input events. In 
another embodiment of the invention, the input event 
controller includes a timer for measuring the time 
elapsed between generation of input events by the 
current input instance. In that embodiment, the input 
event controller will not redefine the current input inst- 
ance until a preselected the period has elapsed from 
the generated of the last input event. 

A more detailed explanation of the input event 
controller is contained in Fig. 6. Processing of input 
events is begun at 92. Input events are obtained at 94 
and a determination is made at 96 whether the input 
event is from the current input instance. If the input 
event is from the current input instance, the current 
time is saved at 98 and the event is delivered to appli- 
cation or program 32 at 100. At this point, the input 
event controller is done at 102 and remains idle until 
receiving another indication to process input events at 
92. If it is determined at 96 that the input event is not 
from the current input instance, a determination is 
made at 103 whether the current input instance has 
been explicitly set by user interface 48. If the current 
input instance has been explicitly set, the input event 
is ignored at 106 and the event controller returns to 
1 02. If it is determined that the current input instance 
has not been explicitly set by user interface 48, a 
determination is made at 104 whether the input event 
is a primary input event. If it is determined at 1 04 that 
the input event is not a primary input event, the event 
is ignored at 106 and the event controller returns to 
1 02. If it is determined at 1 04 that the input event is a 



primary event, the determination is made at 108 
whether sufficient time has elapsed to change the cur- 
rent input instance to that computer display which 
generated the primary event. The determination at 

5 1 08 is made by comparing the current time to the cur- 
rent time which was saved in 98. If the difference does 
not exceed a predetermined value, the primary input 
event is ignored at 106. If the difference does exceed 
a predetermined time period, the current input inst- 

10 ance is changed at 110 to the computer, display which 
generated the primary event. The current time is 
thereafter saved at 98 and the primary event is deliv- 
ered at 100 to application of program 32. It will be 
noted that if the predetermined time is set at zero the 

15 current input instance will in effect be automatically 
changed to whatever computer display is generating 
a primary event. 

Display server extension 34 also comprises a ter- 
minator for terminating the sharing of a particularwin- 

20 dow or for terminating the sharing of all windows at a 
particularly remote computer display. Operation of 
extension 34 in a relation to the termination of share 
display signals is shown in greater detail in Fig. 7. The 
command to unshare the window is received at 112. 

25 In response to this command, determination is made 
at 114 whether all windows are to be unshared. If all 
windows are to be unshared, all instances of those 
windows on the remote server are destroyed at 116. 
If less than all windows are to be unshared, the par- 

30 ticular windows specified are destroyed on the remote 
server at 11 8. A determination is made at 1 20 whether 
any windows remain on the remote server. If windows 
remain on the remote server, the unshare operation 
is concluded at 122. If no windows remain on the 

35 remote server either as determined at 124 or as des- 
troyed at 116, the display resources previously 
created are freed at 124. All connection to the remote 
server is closed at 126. After closing the connection, 
the unshare operation is terminated at 122. 

40 While the invention has been described and illus- 

trated with reference to specific embodiments, those 
skilled in the art will recognize that modification and 
variations may be made without departing from the 
principles of the invention as described herein above 

45 and set forth in the following claims. 



Claims 

so 1. Apparatus for sharing a local display signal from 
a local computer display (10) to at least one 
remote computer display (20), each computer 
display including a display screen (24) and a cent- 
ral processing unit (22), wherein each central pro- 

55 cessing unit includes a display server (28, 30) for 

displaying a display signal on the display screen 
(24), the local computer display (10) further 
including an input device (16), the apparatus 
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being characterized by: 

a display server extension (34), connected 
to the display server (28) associated with the local 
computer display, which display server extension 
(34) is characterized by a connector (54) for 5 
generating a connection with the display server 
(30) associated with the remote computer display 
(20) in response to a first command signal; a sig- 
nal generator (62, 64) for generating a remote dis- 
play signal in relation to the local display signal 10 
also in response to the first command signal, 
wherein the signal generator is characterized by 
a list member (76, 78) for dynamically creating a 
list of display resources for the remote computer 
display and a generator member (90) for generat- 15 
ing the remote display signal in relation to the dis- 
play resources; and a transmitter (66) for 
transmitting the remote display signal to the 
remote display server in relation to the connec- 
tion; and 20 

a user interface (48), connected to the dis- 
play server (28) associated with the local com- 
puter display and connected to the input device, 
for generating the command signal. 

25 

2. The apparatus of claim 1, wherein the local dis- 
play signal is characterized by a window based 
display signal and wherein each of the display 
servers (30) is characterized by a window server. 

30 

3. The apparatus of claim 1 or 2, wherein the remote 
computer display (20) includes a remote memory 
connected to each central processing unit whe- 
rein the display server extension (34), after 
generating the list of display resources, causes 35 
the display resources for the remote computer 
display to be stored in the remote memory. 

4. The apparatus of claim 1 , 2 or 3, wherein the dis- 
play server (28) associated with the local com- 40 
puter display is connected to an application (32), 
wherein the remote computer display (20) further 
includes an input device (26), wherein each of the 
input devices are capable of generating input 
events to be processed by the application (32) 45 
resulting in a change to the image displayed at the 
local and remote computer displays, the display 
server extension being further characterized by 

an input event controller (110) for controlling 
which input events will be processed by the appli- so 
cation. 

5. The apparatus of claim 4, wherein the input event 
controller (110) is characterized by a timer (98, 
108) for measuring the time elapsed between 55 
generation of input events by the current input 
instance, and wherein the input event controller 

will not redefine the current input instance until a 



preselected time period has elapsed from the 
generation of the last input event by the current 
input instance. 

6. A method for sharing a local display signal from 
a local computer display (10) to at least one 
remote computer display (20), wherein each com- 
puter display includes a display screen (14, 24) 
and a central processing unit (12, 22), wherein 
each central processing unit comprises a display 
server (28, 30) for displaying a display signal on 
the display screen, the local computer display 
further including an input device (16), the method 
characterized by the steps of: 

generating a connection with the display 
server associated with the remote computer dis- 
play in response to a first signal from the input de- 
vice; 

generating a remote display signal in rela- 
tion to the local display signal in response to a 
second signal from the input device, wherein the 
generation of the remote display signal com- 
prises dynamically creating a list of display 
resources for the remote computer display and 
generating the remote display signal in relation to 
the display resources; and 

transmitting the remote display signal to 
the remote display server in relation to the con- 
nection. 

7. The method of claim 6, wherein the local display 
signal is shared among multiple remote computer 
displays, and wherein the step of generating a 
remote display signal is characterized by the 
steps of creating a list of display resources for 
each of the remote computer displays, updating 
the list for each rendering of the local display sig- 
nal and creating a remote display signal for each 
of the remote computer displays in relation to the 
display resources associated with each remote 
computer display. 

8. The method of claim 6 or 7, wherein the local com- 
puter display (10) includes a local memory con- 
nected to the central processing unit and wherein 
the remote computer display (20) includes a 
remote memory connected to each central pro- 
cessing unit wherein in relation to the step of 
dynamically creating a list of display resources 
the method is further characterized the step of 
storing the display resources for the remote com- 
puter display in the remote memory and storing 
the location of the display resources in the local 
memory. 

9. The method of claim 6, 7 or 8, wherein the display 
server (28) associated with the local computer 
display (10) is connected to an application (32), 
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wherein the remote computer display further 
includes an input device (26), wherein each of the 
input devices (16, 26) are capable of generating 
input events to be processed by the application 
(32) resulting in a change to the image displayed 
at the local and remote computer displays, the 
method being further characterized by the step of 
controlling which input events will be processed 
by the application. 



10 



10. The method of claim 9, wherein the step of con- 
trolling input events is characterized by the step 
of defining one of the input devices as a current 
input instance whereby only one of the input 
devices (16, 26) will generate input events to be 15 
processed by the application, wherein the step of 
defining one of the input devices as a current 
input instance is characterized by the steps of 
measuring the time elapsed between generation 
of input events by the current input instance and 20 
redefining the current input instance only after a 
preselected time period has elapsed from the 
generation of the last input event by the current 
input instance. 

25 
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